Unsupervised Topic Identification by Integrating Linguistic and Visual Information Based on Hidden Markov Models
نویسندگان
چکیده
This paper presents an unsupervised topic identification method integrating linguistic and visual information based on Hidden Markov Models (HMMs). We employ HMMs for topic identification, wherein a state corresponds to a topic and various features including linguistic, visual and audio information are observed. Our experiments on two kinds of cooking TV programs show the effectiveness of our proposed method.
منابع مشابه
Language acquisition through a human-Crobot interface by combining speech, visual, and behavioral information
This paper describes new language-processing methods suitable for human-robot interfaces. These methods enable a robot to learn linguistic knowledge from scratch in unsupervised ways. The learning is done through statistical optimization in the process of joint perception with a person, combining speech, visual, and behavioral information in a probabilistic framework. The linguistic knowledge l...
متن کاملCompeting Hidden Markov Models on the Self-Organizing Map
This paper presents an unsupervised segmentation method for feature sequences based on competitivelearning hidden Markov models. Models associated with the nodes of the Self-Organizing Map learn to become selective to the segments of temporal input sequences. Input sequences may have arbitrary lengths. Segment models emerge then on the map through an unsupervised learning process. The method wa...
متن کاملTopic Segmentation : A First Stage to Dialog-Based Information Extraction
We study the problem of topic segmentation of manually transcribed speech in order to facilitate information extraction from dialogs. Our approach is based on a combination of multi-source knowledge modeled by hidden Markov models. We experiment with different combinations of linguistic-level cues on dialogs dealing with search and rescue missions. Results show the effectiveness of multi-source...
متن کاملUnsupervised Machine Condition Monitoring Using Segmental Hidden Markov Models
The task of machine condition monitoring is to detect machine failures at an early stage such that maintenance can be carried out in a timely manner. Most existing techniques are supervised approaches: they require user annotated training data to learn normal and faulty behaviors of a machine. However, such supervision can be difficult to acquire. In contrast, unsupervised methods don’t need mu...
متن کاملCombining hidden Markov models and latent semantic analysis for topic segmentation and labeling: Method and clinical application
MOTIVATION Topic segmentation and labeling systems enable fine-grained information search. However, previously proposed methods require annotated data to adapt to different information needs and have limited applicability to texts with short segment length. METHODS We introduce an unsupervised method based on a combination of hidden Markov models and latent semantic analysis which allows the ...
متن کامل